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[57] ABSTRACT 

In accordance with the present invention, an apparatus 
initiates a transaction and includes a capture device for 
capturing transaction data from marks contained on an 
object. The marks have a code corresponding to transaction 
data for initiating a transaction. The capture device includes 
a scanner, operable by a user, for reading marks contained on 
the object. A controller interprets the marks and retrieves the 
transaction data embedded in the marks. The capture device 
originates a telephone call and transfers at least a portion of 
the transaction data to a desired destination for initiating a 
transaction. 

19 Claims, 4 Drawing Sheets 
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APPARATUS AND METHOD FOR include display information, so that at least portions of the 

INITIATING A TELEPHONE TRANSACTION captured data can be discerned by a user of the device, and 

USING A SCANNER the user can thus be kept informed as to the operation of the 

ptft n nv tup imvpntttom devicc ' ^ mcmorv and mc communications circuitry in the 

FIELD OF THE INVENTION $ Q ^ mQ device ^ advanlageously arrangec l so that, in a 

This patent application is related to an apparatus and transaction initiated by the device using captured 

method for initiating a transaction by scanning marks information, a two-way dialog may be initiated between the 

embedded on an object to retrieve transaction data for user and an agent at a remote terminal or a POTS system, 

initiating a transaction. and information may be transmitted to and stored in the 

BACKGROUND OF THE INVENTION 10 dcvicc for latcr retrieval. 

In copending and commonly assigned patent application *° a «>^ug appHcation enUUed "System and Method 

filed by K. G. August et al. and entitled System And Method of Capturing Encoded Data Transmitted Over a Commum- 

For Wireless Capture Of Encoded Data Transmitted With A T catl0 t ns Netwo ^ m a Y ldeo f led ™ bf half of 

Television, Video Or Audio Signal And Subsequent Initia- „ i S ±ir 7"™^^ ' 1994, Scr. No. 

tion Of A Transaction Using Such Data, a portable capture 15 08/210,802 and assigned to the same assignee as the present 

device is used to capture in a wireless manner encoded aPphcaUon, it was recognized that non-perceptible informa- 

non-perceptible data from a light emitting device such as a J™ L be encoded in a television pro-am captured in a 

television or other video or audio output device. The capture * 1 to P bo * > thereafter used to make telephone calk 

device uses the captured data to initiate a transaction, such m ™ e s f l t0 P * ox * e L lectncal ^vice that is "hard-wired 

as placing a telephone call and transmitting a message to a 20 » the circuit between the video services network 

remote agent or automated attendant, and delivering the data and the ^™ «* (« a stand alone unit or alternatively 

to a point-of-sale agent directly or indirectly via a telecom- "P" 1 of ^ c Revision set itself) and thus unfortunately, is 

munication connection. DOt P^able. Also, the set top box is dedicated to one 

tw a«*« ,v n e t u Ai^i^A k„ particular television (or other video source) and thus cannot 

Inis data is part or the ordinary program displayed by the n c f , , x , ^ ^ , . ~ 

■t • , . r . -li u • r * a 25 be shared among several sources. Captured information may 

device and yet indiscernible by a viewer or listener. As an * u j * i_ f c • * , * , j 

, ; i . • u i . i • , . , not be data, but could be reference pointers to data stored 

example, a television monitor may be located in a kiosk or 4 , ' , , . ...... 

. t j j • i , i j *• • c i * j remotely, and needed in order to initiate a transaction, 

other public area, and display the advertising of selected J ' 14 , . . , A , 

. , , . n . i j j. u * r Finally, the user of the set top box may be uncertain as to the 

services and products. The indiscernible data may be infor- , ;, fl1 . r A . , * 

■ j . * , i . j * • i j- nature or the information captured therein, 

mation needed to order those services or products, including 30 r 

prices, delivery intervals, shipping details, coupon offers, . above disclosures provide a system and method for 

and other related information initiating a transaction using wireless capture of information 

Capture can be effected by decoding subliminally modu- obtained . from a video/audio device. However, often con- 

lated video broadcast signals, in a manner suggested in U.S. sumers V1 . ew man y advertisements and program solicitations 

Pat. No. 4,807,031, issued on Feb. 21, 1989, to R. S. 3S m magazines, newspapers and many types of printed media. 

Broughton, et al, the teachings which are incorporated Sometimes advertisements are contained on kiosks, bulletin 

herein by reference in their entirety. Alternatively, a modu- b ™ ds and other locations. It would be advantageous if 

lated carrier, which, for example, can be an amplitude shift se ect P ieces of ^formation concerning the advertisement or 

keyed (ASK) or frequency shift keyed (FSK) signal having solicitation could be retrieved to initiate a transaction by 

its primary frequency components at a frequency (e.g. 25 40 telephone number concerning the vendor of that 

kHz) not usually present in a conventional television signal, Particular advertisement or solicitation and then initiating a 

can be added only to the luminance component of a televi- transaction automatically, 

sion signal, and the data can thereafter be captured using SUMMARY OF THE INVENTION 
bandpass filtering and an ASK or FSK receiver. The device 

includes a memory for storing the data for later use, and 45 The present invention now allows a transaction to be 

communications circuitry to output at least portions of the initiated by a capture device that captures transaction data 

data (or data derived from the captured data) to a remote from marks contained on an object, such as printed indicia 

agent or device, such as via a telephone call or a data transfer in a magazine. The marks have embedded ther ein a cocle 

to a point of sale device. correspondin g to transaction data for initiating a transact ion. 

The encoded non-perceptible data can include associated so fte capture device includes ascanner, operable by user, for 
dialing, routing, or other identification information, so that reading marks contained on die ooject A controller inter- 
other portions of the captured data can be transmitted to an P rcts tne marks and retrieves transaction data embedded in 
appropriate final destination or device. In this context, the t he marks . The captureHevice^includes circuitry associated 
final destination can be (a) a remote location, such as a therewith for o riginating a telephone call and transferring at 
platform arranged to process and consummate transactions, ss least * P 01 ^? 11 °^ tpe trans a fj l0 ° ^.,j L t0 ^ d&S L ired d estination 
or (b) a point of sale system or other device (e.g., TV, stereo, tor fflTtgfffijTa irans acjionTThV marKs to be scanned can 
VCR Plus, smart mouse device, computer, etc.). The other Include a conventional style bar code, alphanumeric 
portions of the captured data are part of the payload to be characters , or Xerox glyphs on the surface or tne object 
communicated to the final destination or device, and can In another aspect of the present invention, the capture 
include product or coupon information that is related to the <jo device can include a memory for storing the marks. At least 
display from which the non-perceptible data was captured, a portion of the transaction data can be displayed on a LCD 
as well as programming or control data. Other information or similar type of display. The transaction data also can 
could include consumer profile information, such as the include dialing information for originating a telephone call 
name, address, credit card number, personal preferences and and descriptive lntormauon about an advertisement or 
other personal information. 65 solicitation that is associated with the marks. 

The capture device can include a built-in-display, such as The capture device can comprise a portable phone having 

an LCD display, and the encoded non-perceptible data can the scanner mounted therein. The portable phone would 
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t ransfer A e ^canned ni ar ks to arjersg nal base statio n having 
a jcgntn ^ The personal base 

staTionalso would originate the telephone call t o appropriate 
circuitry contained therein. In still another aspect of the 
present invention, the capture device can comprise a hand- 
held scanner that sends scanner signals to a phone or 
portable base station having a controller for interpreting the 
scanned marks. 

DESCRIPTION OF THE DRAWINGS 

The present invention will be more fully appreciated by 
consideration of the following Detailed Description, which 
should be read in light of the accompanying drawings in 
which: 

FIG. 1 is a schematic, drawing of one embodiment of a 
system arranged for capture of encoded data transmitted 
using the scanner; 

FIG. 2 is a block diagram illustrating the components of 
the capture device of FIG. 1; 

FIG. 3 is a diagram illustrating one example of the format 
of captured data; 

FIG. 4 is a flow diagram of the process by which data 
embedded in a subliminal visual or non-audible message is 
captured and used; and 

FIG. 5 shows an illustrative block diagram of the scanner 
component of the wireless capture device. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to FIGS. 1 and 5, there is illustrated at 50 
a scanner unit (F IG. 5) that is part of portable capture device 
llJ^FKT"f}TThe scanner 50 unit includes a scanning head 
51 positioned on the bottom of the wireless c&PUire device 
110. In the particular embodiment illustrated with the scan- 
ner head 51 positioned on the bottom of the wireless capture 
device 110, the device is manually oriented in use so that the 
scanner head 51 moves over the marks to be read. The 
scanner unit 50 is wired directly to a microprocessor 220 
(FIG. 2) of the device 110 and works in a manner that will 
be explained below. 

For purposes of understanding, the scanner unit 50 will be 
discussed first followed by general description of the por- 
table capture device 110 and associated units illustrated in 
FIGS. 1 and 2. The scanner unit 50 can communicate with 
the microprocessor 220 through a hard wire link Sib. 
Additionally, as shown in FIG. 5, the scanning unit 50 can 
include a transceiver 5 2 which allows the scanner unit to 
communicate with a scanner pen 52a via a wireless link 52£>, 
such as a radio link, infrared or other communication links 
known to those skilled in the art. The scanner pen 52b has 
a normal scanning head 52c to read marks on an object being 
scanned. The transceiver 52 would receive with the unproc- 
essed output from the scanning head 52c of the scanner pen 
over the link 52b, The scanner unit 50 also includes a 
controller/interpreter 53 that decodes unprocessed output 
from a scanner head 51 into a more compact or standardized 
code or format for communication as part of transaction data 
and as data to be later processed by a microprocessor 220. 
An on/off switch 56 enables a user to turn on and turn off the 
scanner unit to conserve power or a battery 57 if battery 
power is used. 

A memory 54 can allow a user to scan at one period of 
time, and then store the information lor later tr ansmittal to 
the con troller/interprete r 53 and microprocesso r ^ZU at a 
later time. Tne retrieval of data from memory SA can be 
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controlled by transmit control buttons 55. An optional dis- 
play 58 may provide visual feedback for communication, or 
it can display previously scanned marks in a human-readable 
format. A scan control button as one of the control buttons 

5 55 could enable a user to scroll through a plurality of 
previously scanned marks. An optional audible transducer 
59 can provide audible feedback to the user, indicating that 
a successful scan of the object has occurred that the micro- 
processor 220 has received information from the scanner 

10 unit 50. 

The scanner unit 50 of the present invention can be used 
in combination with marks that represents a u niaue_ co de for 
t ransacti on data. A standard bar code format couid be used, 
which has encoded therein an SAO number to be called and 

15 other necessary ^ information for completmg a transaction. 
Xerox glyphs also could be appropriate because the glyphs 
can encode a large amount of data in a short space. FIG. 1 
illustrates an object "M" in the form of a Magazine page 
having a bar code "B" adjacent an advertisement so that 

20 information can be gathered concerning the advertisement 
for initiating a transaction. Additionally, alphanumeric char- 
acters could be scanned, which specify a unique identifier 
for various advertisements. 

Naturally, the device 110 can include a scanner unit 50 

25 having the scanner head 51 as an integral part of the device 
110, but also could include a port 60 that could be wired 
directly to a scanner pen 52. 
There is now described in greater detail various ways in 

30 which t ransaction s can be c omplele d and data captured 
within the wireless capture device 110 of the present inven- 
tion. The following description explains one type of 
apparatus, system, and method which could be used for the 
present invention. Others could be devised by those skilled 

35 in the art. The scanner unit 50 of the present invention would 
be incorporated within the apparatus as described or work 
closely with the apparatus as described. 

Referring first to FIG. 1, and for purposes of background, 
there is shown a schematic drawing of the environment 

40 arranged for the capture of encoded data from the scanner 
pen, and subsequent use of the captured date to initiate a 
transaction with a person at an agent terminal 120, or a 
person at another terminal 121 that is supported by an 
interactive service platform 130. 

45 It should be understood that the data could also be 
received from a light emitting device such as a television or 
audiQ-simal from a speake r. In that instance, in a television 
signal would be received by a television via over-the-air 
transmission, as from transmission tower via a transmission 

50 link, or alternatively supplied by a cable TV connection, or 
from a VCR/video -tape. The video portion of the television 
signal could be displayed on the picture tube or other visual 
display area of a monitor, computer or a television, while the 
audio portion of the television signal is played from speaker. 

55 Associated with the program that is seen and possibly heard 
by a viewer/listener could be non-discernible encoded data 
that is transmitted as part of the video and possibly Qudio 
signal. For example, the program may be an advertisement 
for a service or product, and the indiscernible data may 

60 create a subliminal visual pattern on the visual display area, 
that when properly received and decoded, contains infor- 
mation n eeded to order th ose services or products, mclualng^ 
pncesT'd ehvery intervals, ship ping det ails, coupon offers, 
.and so -on** ■ 

65 Encoding, transmission and decoding of non-discernible 
data in this instance could be accomplished as described in 
a patent application entitled "System and Method for Encod- 
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ing Digital Information in a Television Signal" filed od As explained more fully in connection with FIG. 2, 

behalf of T. Sizer and assigned to the same assignee as the capture device U0 may include a dual tone multi-frequency 

present application, which co-pending application is incor- (DTMF) transceiver arranged to generate a series of audible 

porated herein by reference. Briefly, it was found using a tones. Accordingly, a fourth way to initiate a telephone call 

spectrum analyzer on a typical video signal, that there are $ would apply portions of the data to the transmitter (tone 

comparatively large frequency components at the line rate generator) portion of the DTMF transceiver. Capture device 

and at the frame rate and its harmonics, but that between may then be placed in juxtaposition with the micro- 

these frequencies, there are other frequency bands in which phonc pQrtion of a convcntioaal telephone handset, such that 

little information is carried. One such frequency band is the audMe tones ated ia ture device 110 are acous . 

between 15 and 30 kHz. By adding a low level carrier signal „ rt , , * tU ° , . , . „ • • . , 

- . , & , ...„ r, 10 tically coupled through the handset to receivers in telecom- 

or tone at a frequency in this band, say 25 kHz, the video • *■ * _i n« 

* j j j u * i * aaa mumcations network 115. 

image is not degraded, but a properly tuned decoder can 

receive and decode the encoded information. In this way, Capture device 110 can also output encoded data directly, 

digital information can be subliminally inserted in a video without making a telephone call. This is useful in conjunc- 

signal by adding to the video signal an amplitude shift keyed tion with a point of sale system or the like, which includes 

(ASK) or frequency shift keyed (FSK) carrier signal, and the 15 a docking station or other interface to which the capture 

digital information can later be recovered using ASK or FSK device may be connected, or an IR receiving device or a 

decoding. Encoded data can also be inserted in a television device responding to DTMF. 

signal and recovered by a received that responds to the If an outgoing telephone call in initiated by capture device 

picture displayed on the television, in the manner described 110> me call can aiustrativcly be routcd th^gh telecom- 

in U.S. Pat. No. 4,807,031 cited above. 20 munications network U5 t0 ^ agenl termioal UOy 

The data is received from the scanner pen and within the 0f to an mteractivc ^cc p i at f orm i 30 , which is connected 

portable capture device 110 which is described in more tQ terminaJ m WheQ a ^ com . 

detail in connection with FIG. 2. If any nonKJiscemible ^ ^ m ± caU be routed b a &M 

encoded data is part of a video signal, such sensmg takes the r „i t ' _ . \ , 

c rr u* f j- 1 u • 11 * au ** i matrix 131 to a voice response unit 132 that operates under 

form of light from display area being collected by an optical is . . r t c ■ i j j • 

lens 117. When the non-discernible encoded data is part of me «° n *° l of * P rocess ? r 134 '"i™? ? a ? 

the audio signal, such sensing can take the form of sound "P*™ 1 ™™ dcd can be P*™&* <° the attendants, or 

from a speaker that is collected by a microphone 211 (FIG. ? ro f s ^° r U i? n P erform a md re f eva / 

2). In e ' itner event, theft could be wirelesTcommu T Tc ation of * ^oase 131, using encoded data as a key, in order to 

the information from the scanner pen and in some instances 30 Actuate a desired transaction. 

where a more complicated device is used, from a television For certain transactions, information connected with a 

to capture device 110 such that the encoded data is "viewed" transaction may also be transmitted from service platform 

or llneard " rather than transmitted through a wired ™ to capture device 110, either for display to a user,> 

connection, or through a more conventional radio frequency storage for later use, or output to a point of sale system or 

communication. 35 device. This information may, for example, be confirmation 

In addition to receiving non-discernible encoded data information, indicating that a transaction has been effected, 

from the scanner pen, the capture device 110 has the or delails regarding a just completed transaction, such as 

capability of (a) storing the encoded data, (b) transmitting ticket information relating to a travel reservation, 

(or otherwise outputting) the encoded data (or information Referring now to FIG. 2 there is shown a block diagram 

retrieved using such data) to a remote location or device, and 40 illustrating in more detail the components in one embodi- 

(c) displaying the encoded data to a user. The data may ment of capture device 110 of FIG. 1. If the encoded 

include information for initiating a transaction or originating non-perceptible data is inserted in the video portion of a 

a telephone call, as well as additional information (e.g., price television signal, the images displayed on a visual display 

and ordering information) associated with the scanned mate- area a monitor or television are captured by optical lens 117 

rial. The remote location can be agent terminals 120 or 121, 45 and an associated photo-detector 203, which is arranged to 

i nteractive service platform 130 , or a point of sale system, supply an electrical signal to a filter/receiver 215 represent- 

and the communication between the capture device 110 and ing the image. 

the remote location may be one-way or two-way. On the other hand, if the encoded non- perceptible data is 

In the case where encoded data is to be output from inserted in the audio portion of a television signal, e.g. the 

capture device 110 via a telephone call, the call may be 50 output from a speaker is captured by a microphone 211 and 

initiated and transacted in one of several ways, as illustrated an associated amplifier 213, which is arranged to supply an 

in FIG. 1. First, the data may b e transmitted over a wireless electrical signal to filter/receiver 215 representing the sound 

li nk to an as sociated tel epnone b ase station 1U V that is, in energy. In either event, the encoded non-perceptible data is 

turn, connected^ (o a telephone' line ill that is part of a decoded in the filter/receiver 215 in a manner consistent 

tele comm un ications network n "5rCornmunication between 55 with the manner in which the original data was encoded, 

capture device 110 and base station 109 may be accom- Thus, filter/receiver 215 can be arranged to perform the 

plished in a variety of ways; as an example, the same same functionality as the elements illustrated in FIG. 4 of the 

signaling and transmission can be used as is presendy used above referenced Broughton et al. patent, or, alternatively, 

in communication between a .c»rdless»teIcfihQne handset and the operation of filter/receiver 215 can be as described in 

its associated base station. S econd, capture device 110 may 60 conjunction with FIGS. 4 or 7 in the copending application 

be directly connected io a telephone line 112 through an of T Sizer. In each instance, it is noted that the capture 

interface that includes a standard telephone jack 114. Third, device 110 receives encoded data by receiving scanned data 

capture device 110 may include the funct ionaUt y^ QL a from the scanner pen 52a and in some instances with more 

cellular telepho ne, so that the data may be communicated to complicated devices, by "watching" or "listening to" the 

ajremote locanon via a wireless call placed _Jo_a_jnobile 65 output of a television (or another similar display device), and 

^teleph on e switching j)ffice (M TSPV140, which is in turn that the capture device 110 is not connected to television or 

connected to telecommunications network 115. the other display device by a cable or wires. 
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The output of filter/receiver 215, representing the data When a user of capture device 110 desires to use any of 

captured by capture device 110, is applied to a micropro- the data stored in memory 221, including data stored as a 

cessor 220, which is arranged to perform various data result of the AUTOSAVE function, the contents of the 

processing and control functions in coordination with pro- memory 221 may be retrieved and displayed on display 225 

grams stored in an associated memory 221 as well as inputs s by initiating the RECALL function upon activating button 

received from a user of capture device 110. Generally 2 45. This permits a user to be aware of exactly what 

speaking, capture device 110 may operate in an active or a information was previously captured and stored. Through 

passive mode. In the active mode, capture device 100 to me user win be able tQ nbtifody peruse or 

responds only to user initiated I capture commands In the scroll ^ h ^ stofed d SQ ag {Q ^ Qr use 

passive mode, capture device 110 captures all of the data „„ tU ° c a * * ** c u ** <\ac * .i. 

sent to it while in that mode. In eithel -mode, captured data 10 P ™T^k f T T , ^ V? ! J** 

may be routed by microprocessor to memory 221 and stored DELETE function, whereby portions of the data stored in 

for use at a later time, as determined by the user. The memo ^ } 1X ** f Actively erased. In order to conserve and 

captured data may also be displayed on a display 225, such merebv rec y cle the stora e e opacity of memory 221, the 

as a liquid crystal display, so that a user will be aware of microprocessor 220 may also be arranged to manage the 

exactly what information was captured. 15 contents in memory 221, so that the oldest information 

fr* The control programs contained in memory 221 can stored herein could be cycled out and deleted as new 

implement numerous functions, which broadly speaking, information is captured and stored. 

can be categorized as (a) functions relating to data capture, Turning now to consideration of the use of already 

such as SAVE and AUTOSAVE functions, (b) functions captured data, it is an important functionality of capture 

relating to output of already captured data, such as DIAL and 20 device 110 to permit such data to be output upon a command 

SEND DATA functions, (c) functions relating to memory f rom a user. Such data, when output, can be used to (a) make 

manipulation, such as the RECALL and DELETE functions. a telephone call, and, when the call is answered, to provide 

The above enumerated functions are initiated when respec- information to a live or automated attendant that received 

tive buttons 241-246 are activated, and the activation ^signal me call> or ^ mitiate a transactioil( such ^ by interacting ' 

ou put from a button is apphed to microprocessor 220 via a 25 ^ a ^ tenninal Qr ^ ed feceive 

button interface 240. Each of the Junctions is discussed ^ ^ ^ ^ deyice ^ ^ a ycR p ^ Qi a stereo 

wru *u a *• a u c In accordance with the arrangement shown in FIG. 2, data 

When the SAVE function is initiated bv activation of * . • * i u n • . j ■ » 

• it iU « a • im " Vu V j j output via a telephone call can be initiated in several ways. 

button 241, the capture device 110 is in the active mode, and r r j 

the encoded data received from a scanner or contained in the 30 First > captured data can be routed by microprocessor 220 

current audio or video output of a television is captured. This fr° m memory 221 to a modem 246 and then to a base station 

is accomplished, for example, by activating optical lens 117 interface 250, so that the information can be communicated 

and photo detector 203, or microphone 211 and amplifier to telephone base 109 of FIG. 1. This in turn allows a 

213, for a relatively brief period of time, typically on the conventional telephone call to be originated from telephone 

order of several seconds, so that encoded data associated base 109. ^ 

with the current program is processed by filter/receiver 215 35 Second, captured data can be routed through modem 246 | 

and stored in memory 221. A visual or auditory cue could be l0 a ^ i nter face 253, which allows capture device 110 to j 

contained m the video or audio program to indicate to a user be physica ]i y connected to a terminal or docking station for / 

°! a o C A P ,^l e d6V1Ce that . there 15 data 10 be <*P^ed. When m f ormation off loading . ^ 

the SAVE function is activated for the scanner or a television ™. , , . , , 

signal, the microprocessor 220 may control display 225 to 40 Jhird captured data can be routed to a DTMF transceiver 

indicate the current status, e.g., that the capture device is in 247 > wmch Glides a tone generator arranged to output 

the process of receiving and capturing data. When the data DTMF tones. These tones can be directly connected to a 

has been captured, the microprocessor 220 may control the telephone line 112 via a standard connection such as RJ11 

display 225 to actually display some or all of the data, so that J ack U4 - Alternatively, capture device 110 can be placed in 

the user can be aware of information that had been sublimi- 45 juxtaposition with the microphone in a telephone handset, 

nal and indiscernible. The display can also indicate that the and the audible tones can be applied and used much like an 

device is "aimed" correctly. audible frequency autodialer. * _ 

When the AUTOSAVE function in initiated by activation Fourth, captured data can be routed through modem 246 1 

of button 244, capture device 110 is in the passive mode. In to a cellular telephone 252, which can initiate a cellular call, 

this mode, capture device 110 captures a series of encoded 50 When a cellular connection is completed, the captured data 

data that may be contained from scanned material or in each can be output in encoded form or an audible tones, 

of a series of programs that can be viewed or heard on a For each of the arrangements just described, a telephone 

television. This can be accomplished, for example, by acti- call may be originated using the DIAL function. This 

vating optical lens 117 and photo detector 203, or micro- function in initiated by activation of button 242. With this 

phone 211 and amplifier 213, for a relatively long period of 5s function, dialing information, which is part of the data 

time, typically on the order of several minutes or hours. captured by capture device 110 and now stored in memory 

Encoded data captured from the various programs that are 221, is retrieved. This information is then further processed, 

displayed on display area 105 or played through loudspeaker so that a telephone call can be initiated. In some instances, 

106 over a long period of time are processed by filter/ a call is originated by application of stored data to DTMF 

receiver 215 and stored in memory 221. As with the SAVE 60 transcriber 247, so that audible tones can be output. In other 

function, when the AUTOSAVE function is activated, instances, a data call can be initiated by appropriately 

microprocessor 220 may be arranged to control display 225 formatting stored data. In yet other instances, such as when 

so as to indicate the current status, e.g., that the capture a cellular call is dialed, stored dialing information may be 

device is in the process of receiving and capturing data. applied to an outgoing number register. The exact manner in 

It should be understood that the autosave function is used 65 which information is output from the capture device 110 can 

with a more complicated device having means for receiving vary, in accordance with several embodiments of the present 

audio and visual signals. invention. 
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While the DIAL function is used to output certain cap- 
tured information needed to initiate a telephone call (or other 
data output function), the SEND DATA function, initiated by 
activation of button 243, is used to output other portions of 
the captured data stored in memory 221, pertaining, for 
example, to a transaction that the user desires to make. This 
additional data is retrieved from memory 221 and appropri- 
ately transmitted, depending upon the manner and type of 
telephone call involved. Thus, data may be output either via 
base station interface 250 to telephone base 109, or via RJ11 
jack 114 onto telephone line 112, or via cellular phone 252 
to MTSO 140. Note that if output occurs directly, without a 
telephone call, the SEND DATA function may cause infor- 
mation from memory 221 to be output via wire interface 
253. During the SEND DATA function, the information 
being output may also be displayed on display 225. This 
allows a person using the capture device to identify the 
information that was captured, and use the information in an 
actual transaction. 

It is to be noted here that capture device 110 of FIG. 1 may 
optionally include an automatic speech recognition circuit 
245, an in frared (IRj) transmitter^ ife',' a handset j 30 and a 
keypad 247>The purpose or ik uransmitter235"is to allow 
capturea data to be output directly to a device such as a point 
of sale system or a VCR or the like, via infrared transmis- 
sion. The purpose of speech recognition circuit 245 is to 
convert captured data to spoken phra ses, which can be 
played to a user or to an attendant after a telephone call is 
initiated. The purpose of handset 230 and keypad 247 is to 
allow capture device U0, in addition to being used in 
accordance with the present invention, to be used to com- 
plete conventional dialed telephone call s. 

For' background purposes, a televised* advertisement for a 
product could include additional ordering or "coupon" infor- 
mation embedded in a subliminal visual pattern within the 
video image displayed on a television. The coupon infor- 
mation describes the item(s) offered for sale, the regular 
price, the coupon value, and contains additional information 
needed for ordering. This embedded information could be 
transmitted between a television and capture device at a rate 
of about 60 bits per second, that is sufficient such that the 
necessary information can be transmitted in a very brief 
period of time. In the application just described, the embed- 
ded product information, dialing number, coupon informa- 
tion and necessary che debits together comprise approxi- 
mately 2,000 bits of information, so that between three and 
four seconds would be required for transmission. Once the 
coupon information is stored in capture device 110, the user 
of the capture device can supplement the coupon informa- 
tion with user entered data which can be entered using 
keypad 247. This supplemental information may include 
credit card or other billing information pertaining to the user, 
as an example. 

As shown in FIG. 3, the information represented by the 
encoded data such as from the scanner can be organized in 
several fields. Using the coupon application as an example, 
a first field 301 contains a telephone number which may be 
used to originate a telephone call in order to order the 
product to which the coupon applies. Illustratively, this will 
be a toll-free or "800" number. Other information associated 
with the coupon can include a product description in field 
303, an expiration date in field 305, the time that the 
advertisement is televised in field 307, the number of 
television channel running the ad in field 309, and a serial 
number for the ad in field 311, identifying either or both the 
particular ad and its sequence in an ad campaign. It is to be 
noted that various other information can also be included in 
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the information illustrated in FIG. 3, such as keywords or 
attributes describing the received encoded data, as well as 
information indicating that a product is available in particu- 
lar colors or sizes. The keywords would be useful in 
S retrieving from memory 221, information relating to specific 
products or advertisers. 

The process by which information embedded in a sub- 
liminal visual, audible message or scanned indicia is cap- 
tured and used is illustrated in flow diagram form in FIG. 4, 

10 As indicated previously, two general modes of operation are 
contemplated, namely a "passive" mode and an "active" 
mode, both of which follow a "start" step 401. 

In the passive mode, a user desires to operate the capture 
device 110 in an unattended manner, and to capture all of the 

15 encoded data that may be subliminally displayed on a 
display device or output from speaker over a relatively long 
period of time, typically several minutes or hours, until the 
user, at some later time, desires to discontinue or terminate 
the capture. This mode is initiated using AUTOS AVE 

20 functionality, by activating button 244. When this is done, a 
positive response is obtained in step 502, so that data 
capture, storage and display, all as described below in 
connection with step 507, occur. While in the passive mode, 
capture is terminated by subsequent activation of the same 

25 button 224. 

In the active mode, a user operates capture device 110 in 
real time, typically while scanning a product or bar code, or 
in more complicated devices viewing a video display or 

3Q listening to an audio presentation. Scanning a product or bar 
code, or in more complicated devices the user activates the 
SAVE button 241. When button 241 is activated, a positive 
result occurs in step 503, thereby capturing the encoded 
data, displaying all or a portion of the data on display 225, 

35 and storing same in memory 221, all in step 507. Until the 
SAVE button is activated, capture device 110 may be in a 
"wait state" 505. 

The user of capture device 110 determines that the appro- 
priate data has been captured by reviewing the information 

40 seen in display 225. After the captured data has been 
reviewed and determined to be correct, activation of the 
DIAL button 242 on the portable capture device 110 in step 
509 initiates step 513, by which stored dialing and/or routing 
information, illustratively in field 401 of FIG. 4, is recalled 

45 from memory 221. A call is then originated launch, such by 
transmitting the dialing information from memory 221 
through base station interface 250 to base station 109 and 
thence to telephone line 111 and telecommunications net- 
work 115 to interactive service platform 130. The call may 

50 be a local or long distance call made using a "plain old 
telephone service" (POTS) line; alternatively, a toll-free call 
may be launched using an 800 number. Desirably, automatic 
number identification (AN1), called ID, and other features 
available in the telecommunications network may be used to 

55 provide additional information to the called party, in addi- 
tion to the captured data that is transmitted in succeeding 
steps in the process. Until the DIAL button is activated, 
capture device 110 may be in a "wait state" 511. 
After the call has been originated, a determination is made 

60 in step 515 that the call has been answered and that the 
SEND DATA button 243 has been pushed. (Until the SEND 
DATA button is activated, capture device 110 may be in a 
"wait state" 517.). When a positive result occurs in step 515, 
information contained in fields 403-411 is transmitted to the 

65 called destination in step 519. As stated previously, from the 
point of view of the called party, the information received 
includes details concerning the advertised product, the iden- 
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tity of the caller, and other information associated with the an additional method of inputting telephone numbers and 

item that was initially displayed or mentioned on the tele- coupon and/or product information. The hand piece of this 

vision program. Advantageously, the advertiser will know stationary unit would be used to place a call and send the 

more about their customer that ever before. This is because d a t a . 

the advertiser will ^be abl< sto determine from the transmitted s ^ , inventioD ^ DOt limit6(1 t0 live tdevised 

mformauon winch advertisement draw the business, how ^ ^ ako ed ^ conjunc(ion ^ 

long it took the caller to respond to the ad. and the geo- \ & , % a c T nn t 

graphic location of the callers, based upon ANI or called ID. stored Vld *° P r °f ams a j. In his 

It will be easy to tell which ads in a campaign are most arrangement, advertisements and other encoded information 

successful m mc ^ded in videos at the time they are recorded or at the 

T j ... . 4 - 4l _ 30 time they are mastered and put onto video cassettes. A 

In accordance with one optional arrangement of the . ' . ■ -j . . . 

, . 4 . . , j . viewer watching a video with such an ad can respond 

present mvention, when data is captured and stored in step . t t & . , . *: 

•a- 1 11 * j j * • j *«u -1 unmediately to reserve another video, purchase one of the 

507, they newly collected data is compared with previously . 4 , ' - - #1 * « «ru 

* a j * n 7L * u • r j j i ■ * j * ■ items advertised, or order catalogs automatically. When a 

stored data. When a match is found, any duplicate data is A . \ • « j j j . ■ < 

a at aa*' *u • c • • a u • program containing subhminally encoded data is viewed, 

dropped. In addition, the information in various fields is f. 6 . - & -L TAT . „ t . . ' 

• j 4 1. * . , , • . 4 . 3 5 the viewer simply presses the DIAL button, launching a 

examined, to assure that the data captured is m the appro- A . , n * \* .i nr k m A , * 

. , r . Tf . j . \ . . j . rr ,. telephone call, and then presses the SEND DATA button, 

pnate format. If an error is detected in any data, the j. *. a a t t. j * * 

f , i_ j i . j j « j . „ . , ™ . sending captured data, such as product information, to an 

information may be deleted, and new^ data collected. This A . \. . • .j-^* i • r 

••• « j ! # . , . ffA - 1 agent, who can verify the order using the additional lnfor- 

is accomphshed by repeating capture step 507 several times. ** *u • . j * j * *l j 

_ * / • r , • ■ maUon that was captured or stored in the device. 

In another application or the present invention, an inter- on _ ..«■ /• ■ 

active television capability is provided in connection with a J The Portability of the present invention can be used to 

game show or television drama. For a game show, an ^vantage m implementing what can, in effect, be called a 

audience would be asked to vote on various aspects of the Roaming Bulletin Board . A user can be attending a 

game. This could include questions such as which person conference or traveling through the airport where kiosks or 

should go on a date with the contestant, or which singer is M bulle ^ n boarc h m *P- In L case ° f a conference, an 

the best? The audience would be instructed to press the * ttei J dee ™ uld ^ough the conference viewing the 

"SAVE" button on their capture device at the appropriate ^P 1 ^ 8 * Wh ™ **» attendee sees a dls P, la y °J m } QK ^ he °J 

time specified for their choice. The viewers vote would then she P omts L ca P ture *™ a towards ^ and 

be cast by depressing the DIAL button, communicating with captures the non-discernible encoded data from either the 

the game show host, and then transmitting information 30 Splayed image or the sound output. Later, the user 

indicating the vote by depressing the SEND DATA button. launche f ^ telephone call to the telephone number specified 

Alternately, one number could be transmitted and an auto- mcluded * |he captured data, and sends out coupon 

mated interactive voice platform such as the MoWorx™ information that is also part of the captured data, 

platform available from AT&T could offer options to the It is further to be noted that the present invention can be 

caller. These calls could be toll free calls, or, alternatively, 35 used 311 tne context of automobiles and mobile telephones, 

billed to the caller. When a capture device in accordance with the invention is 

In yet another application of the present invention, a video placed in a car„ it can receive and capture non-discernible 

on demand capability can be provided. A viewer sees a video encoded data contained in the audio output of the car radio, 

he or she would like to see advertised on a previewing ^ captured data can include a toll free or conventional 

network. AN instruction to press the DIAL button on the 40 telephone number for originating a mobile cellular telephone 

capture device is made on the previewing channel to indicate cal1 &om the car. The call may be placed to an interactive 

to the viewer that he or she can press the button to order a service platform, and additional captured data, such as 

particular video. The call would be placed to a voice coupon or similar information, can then be used to effectuate 

response system used to reserve the video on demand. a transaction. 

Information about which video the called wanted to see is 45 Various modification and adaptations of the present inven- 

sent over the phone lines once the call is connected. The tion will be apparent to those skilled in the art. For example, 

caller would merely have to acknowledge the order and the functions provided by the present invention may be 

select a time slot. combined with those used in a personal digital assistant 

The present invention can also be employed in the context (PDA) or a laptop computer. If desired, a simultaneous voice 

of programming of a VCR, particularly where the user so and data (SVD) modem of the type available now from 

already has the capabilities provided by VCR Plus, a product AT&T could be provided in capture device 110 to allow 

that is commercially available. In this embodiment, a code communication both by voice and data transfer, at the same 

sequence associated with and representing a particular tele- ume - Various functions can also be added to the processes 

vision show constitutes the information included in a tele- and applications described. For example, telephone base 109 

vised advertisement. When the ad is viewed, the viewer can 55 ma y be programmed to dial a number of series of numbers 

press the SAVE button and send the sequences to the VCR at specific times, when certain amounts of information or 

Plus using IR transmitter 235. While the portability of data have been collected, or based upon some criteria, 

capture device 110 is advantageous, it is to be noted that in Capture device 110 could then send collected information 

some arrangements, the functions of capture device 110 and "in bulk" to interactive service platform 130. For this 

telephone base 109 may be combined in a single stationary 60 purpose, modem 246 could be used, so as to send the 

unit, which might resemble a cordless telephone base sta- information more efficiently. 

tion. In this event, the functionality of capture device 110 In accordance with the present invention, a capture device 
would be included in the stationary unit, and that unit would now can initiate a transaction by capturing transaction data 
be arranged, in the manner previously described, to collect from marks contained on an object, such as a magazine 
information. In this arrangement, the stationary unit could 65 advertisement, where the marks have embedded therein a 
also be adapted to utilize input devices such as optical code corresponding to transaction data for initiating a trans- 
character recognition (OCR) or scanners that would provide action. The capture device includes a scanner, operable by a 
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user, for reading marks contained on the object and a being indiscernible by a viewer or listener, said capture 

controller for interpreting the marks and retrieving transac- device including means for receiving one of an audio 

tion data embedded in the marks. Through associated appa- and video stream having embedded therein a code 

ratus as described above, a telephone call can be originated containing transaction data for initiating a transaction, 

by information contained in the transaction data in at least a S & fi „ er for ^ tin &e marks ^ retrievi tfansac . 

portion of the transaction data transferred to a des.red don djta cmbedded in y, c marks and 

destination for lmuating a transaction. As a result, it is now , . t t , . „ ... 

possible now for magazines, newspapers, printed media and means associated with the capture device for originating 

many other objects to contain marks relating to an adver- a telephone call based on the retrieved trans- 

tisement or solicitation which can be easily scanned and a 10 0 ?? tl0n a ' 

transaction completed to the vendor of the advertisement or 8 * n ? apparatus according to claim 7 including a storage 

solicitation. This saves much time and allows easier access for storing for the marks 

to services and products. 9 * ^ a PP aratus according to claim 7 including a display 

... j , . i -ii . r iL f° r displaying at least a portion of the transaction data to a 

What has been described is merely illustrative of the user r 

present invention. Other applications to wireless telephones, 15 ' . 

r 4 iL • , X . 1W. The apparatus according to claim 7 wherem said 

computers or other commumcaUon systems other than the ^ dialing information for originating 

disclosed system are contemplated as being within the a ^pi^g ca jj 

knowledge of one skilled in the art and may be utilized n Tn. * . , . - . 

. 5 c *u j flL 11. The apparatus according to claim 7 wherein said 

without departing from the spint and scope of the present , , f . , j j . 4 . . f t_. 

invention 20 transact1011 " ata includes descnptive information about an 

„, . * . . . , . j . advertisement or solicitation that is associated with the 

That which is claimed is: marks 

1. An integrated, portable capture apparatus for initiating t *> t. , j. , , • - , 

* i u C j * *• • • I 2 - apparatus according to claim 7 wherem said 

a telephone-based transaction, composing: , a ■ • f\ , , . 

r 1 v 6 capture device comprises a portable phone, and said means 

a portable telephone; ^ for originating a telephone call comprises a personal base 

a scanner integral with the portable telephone, operable station interface. 

by a user, for reading marks contained on an object, the 13. The apparatus according to claim 7 wherein said 

marks having embedded therein a code corresponding capture device comprises a hand-held scanner. 

to transaction data for initiating a transaction, 14. A method for initiating a transaction in an integrated, 

controller means for interpreting the marks and retrieving 30 wireless capture device that includes a portable telephone 

transaction data embedded in the marks, and with a scanner comprising the steps of: 

means within the capture device for originating a wireless scanning marks contained on an object with the scanner, 

telephone call based on the retrieved transaction data interpreting the scanned marks to retrieve transaction data 

for initiating the transaction. embedded therein, and 

2. Tne apparatus according to claim 1 including a storage 35 originating a wireless telephone call, based on the 
for storing the marks. retrieved transaction data, to a desired destination for 

3. The apparatus according to claim 1 including a display initiating a transaction. 

for displaying at least a portion of the transaction data to a 15. The method according to claim 14 including display- 

user ing at least a portion of the transaction data to a user. 

4. The apparatus according to claim 1 wherein said 40 16 ^ method according to claim 14 wherein the trans- 
transaction data includes dialing information for originating act ion data includes dialing information for originating the 
a telephone call. wireless telephone call. 

5. The apparatus according to claim 1 wherein said 17, Th e me thod according to claim 14 wherein the trans- 
transaction data includes descriptive information about an action data includes descriptive information about an adver- 
advertisement or solicitation that is associated with the 45 tisement or solicitation that is associated with the marks. 
ma f^ s ' 18. The method according to claim 14 wherein originating 

6. The apparatus according to claim 1 wherein said means step ^ performed by a personal base station interface 
for originating a telephone call comprises a personal base integral with the capture device. 

station interface. 19 memo d according to claim 14 wherein the capture 

7. An apparatus for initiating a transaction, comprising: 50 device comprises a hand-held scanner, 
a wireless capture device arranged for the wireless capture 

of data directly from an audio/visual display, said data ***** 
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